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Executive Summary 



■ 



Computer-based testing (CBT) has emerged as one of the recent “innovative” approaches to assessments 
most pursued by states. CBT is lauded as the answer to having cheaper and speedier test delivery for 
state and district- wide assessments. It is also seen by some as an avenue toward greater accessibility for 
students with disabilities. In this report we explore the context of CBT, current state computer-based 
tests, and considerations for students with disabilities, in part as follow-up to a similar exploration that 
occurred in the early 2000s when just a few states were beginning to develop and implement CBT for 
their state assessments. Nine considerations for states and districts are presented: 

• Consider the assumptions and beliefs of various stakeholders about computer-based instruction 
and assessments. 

• Consider the system as a whole, from the computer infrastructure to classroom and instructional 
experiences with computers before deciding whether and how to use CBT. 

• Consider the computer or online platform first, with input from individuals who know students 
with disabilities and their accessibility needs. 

• Consider a process for bringing in the needed expertise to delineate the specific accessibility fea- 
tures of CBT, and to determine what specific accommodations may still be needed by students with 
disabilities, as well as to determine whether a computer-based test may create new accessibility 
issues. 

• Determine the policies for which accessibility features will be available to all students and which 
are designated for specific groups of students, such as students with disabilities. 

• Consider how to track the use of accessibility features incorporated into CBT design. 

• Field test the accessibility features of the computer-based test at the same time that the computer- 
based test is field tested. 

• Examine results from CBT for students with disabilities to determine whether there are any features 
or characteristics of the assessment that might need reconsideration. 

• Develop training for teachers and students to ensure that students benefit from accessibility fea- 
tures. 



Table of Contents 



Overview 1 

Contextual Issues Related to Computer-based Testing 2 

Technological Capacity in Schools 2 

Universal Design Applied to CBT 3 

Perceived Advantages and Challenges of CBT 4 

Current Federal Programs that Promote CBT 4 

Analysis of States’ Computer-based Tests 5 

Regular Assessment 6 

End of Course Exams 9 

Discussion and Considerations 10 

Conclusions 15 

References 16 

Appendix A: Advantages and Challenges of Computer-based Tests (CBTs) 21 

Appendix B: Computer-based Tests: Specifications and Details 31 

Appendix C: Web Sites used in Analysis of States’ Computer-based Tests 41 



Overview — 



Computer-based testing (CBT) has become widespread in recent years. Some states now use 
an online platform as the primary delivery mode for one or more computer-based tests used for 
accountability purposes. When CBT was emerging in state testing in the early 2000s, Thompson, 
Thurlow, Quenemoen, and Lehr (2002) examined the implications of CBT for students with 
disabilities. There was not much literature about the use of CBT for large-scale assessments 
at that time, and Thompson et al. worked with states to explore what needed to be considered 
during development for students with disabilities and how states might address the needs of 
these students for accommodations in a CBT environment. 

Since the early 2000s, much has occurred in CBT. CBT seems to have advantages over paper 
and pencil testing, both for states that run the assessment programs and for the students who 
participate in them. These advantages are recognized by the U.S. Department of Education, 
which in one of its major initiatives (Race to the Top Assessment Program), encouraged the 
development of CBT. There currently is strong interest in CBT and advocates have identified 
many positive merits of this approach to assessment including: efficient administration, stu- 
dent preference, self-selection options for students, improved writing performance, built-in 
accommodations, immediate results, efficient item development, increased authenticity, and 
the potential to shift focus from assessment to instruction (e.g., Becker, 2006; Salend, 2009; 
Thompson et al., 2002). CBT also allows new ways of assessing students that move beyond 
the traditional multiple choice and constructed response items. For example, innovative as- 
sessments are now being developed that enable students to manipulate data and role play. Yet, 
as states move forward with CBT they are discovering that it is important to consider not only 
the positive benefits, but also potential negative unintended consequences. These include, for 
example, the possibility that additional training will be needed for students with disabilities to 
interact successfully with computers and the challenges of determining the best way to present 
some accommodations such as screen readers. 

Despite the fairly dramatic increase in attention to CBT, accessibility challenges continue to 
have the potential to reduce the validity of the assessment results and to exclude some groups 
of students from assessment participation. In the early years of CBT many fairly basic design 
issues baffled testing companies and states as they sought to transfer paper and pencil tests onto 
a computer-based platform (Thompson, Quenemoen, & Thurlow, 2006). Many of those issues 
have been resolved. Some states also believe that CBT may be more efficient to administer 
than paper and pencil based tests, and new test designs may have the potential to improve the 
assessment of students with disabilities. For example, some accommodations can be embedded 
in computer-based tests and there may be less variability in how some accommodations are 
delivered (for example, a screen reader may deliver the read aloud accommodation more consis- 
tently than a human reader). However, students with disabilities may be at a great disadvantage 
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if their wide range of access needs are not considered from the beginning of the development 
process (Thompson et al., 2002). 

The purpose of this report is to highlight states’ computer-based tests and the issues that should 
be considered as they are designed and implemented to include students with disabilities. This 
report also suggests factors to consider when designing computer-based tests. This report has 
three sections: (a) description of contextual issues; (b) analysis of states’ CBT; and (c) discus- 
sion of considerations for ensuring that computer-based tests are accessible for all students, 
including students with disabilities. 



Contextual Issues Related to Computer-based Testing 

The implementation of CBT occurs within a context that both supports and limits its use. In this 
section, we briefly address several of the contextual factors that surround CBT including: (a) 
the technological capacity of schools to support CBT, (b) universal design applied to CBT, (c) 
perceived advantages and disadvantages of CBT, and (d) current federal programs that promote 
CBT, such as the Race to the Top Assessment Program. 

Technological Capacity in Schools 

Access to computers and Internet capabilities have for some time been a stumbling block for 
the push to widespread use of computer-based and online assessments. For example, Becker 
(2006) questioned “digital equity” in computer access, computer use, and state-level technol- 
ogy policies. He used data from the National Assessment of Educational Progress to examine 
digital equity, and reported that “students in rural schools or schools with high percentages of 
African American students were likely to have less access to computers” (p. 1). Becker did not 
examine whether having a disability had any impact on computer availability or use. 

A nationally representative school-level survey on information technology conducted by the 
National Center for Education Statistics (Gray, Thomas, & Lewis, 2010) reported several find- 
ings about the availability and use of technology in schools in the fall of 2008. The results 
generally indicated that computers with Internet access were available for instruction, and 
that the ratio of instructional computers with Internet access was 3 to 1. The large majority of 
computers in public schools were used for instruction. Schools also reported using a district 
network or the Internet to provide assessment results for teachers to individualize instruction 
or to inform instructional planning; nearly three-fourths provided online student assessments. 
Full-time technology staff members were available in about one-third of low poverty schools 
and one-fourth of high poverty concentration schools. The survey did not ask about availability 
of computers to students with disabilities, or about the use of computers for statewide testing. 
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Universal Design Applied to CBT 



The term “universal design” applied to assessments in general has been defined in several ways 
(CAST, 2009; Thompson, Thurlow, & Malouf, 2004). Universal design of assessment generally 
means an approach that involves developing assessments for the widest range of students from 
the beginning while maintaining the validity of results from the assessment. Universal design 
also sometimes refers to multiple means of representation, action/expression, and engagement. 

The application of universal design to paper-based assessments has received considerable at- 
tention (Johnstone, 2003; Johnstone, Altman, & Thurlow, 2006; Johnstone, Altman, Thurlow, 
& Moore, 2006; Johnstone, Liu, Altman, & Thurlow, 2007; Johnstone, Thompson, Miller, & 
Thurlow, 2008; Johnstone, Thurlow, Thompson, & Clapper, 2008; Thurlow, Johnstone, & Ket- 
terlin-Geller, 2008; Thurlow, Johnstone, Thompson, & Case, 2008). More recently, attention has 
been paid to applying the principles of universal design in a technology-based environment. For 
example, Russell, Floffman, and Higgins (2009a) demonstrated that the principles of universal 
design could be applied to computer-based test delivery. Technology also can be used to more 
seamlessly link instruction and assessment. For example, Salend (2009) specifically identified 
a variety of technology-based approaches that might be used for classroom assessments — for 
example, curriculum-based measurement (CBMs) assessment probes, digitalized observations 
and portfolios, and self-monitoring tools. 

Dolan et al. (2009) prepared a set of guidelines specifically for computer-based assessments. The 
principles address test delivery considerations, item content and delivery considerations, and 
component content and delivery considerations. A variety of topics relevant to computer-based 
testing and universal design is addressed in the component content and delivery considerations 
section of the guidelines (e.g., text, images, audio, video), with each organized according to 
categories of processing that students apply during testing. 

As the application of universal design principles to CBT has been considered, there also has been 
increased attention to various assistive technology requirements. Assistive technology devices 
can include such things as speech recognition or text to speech software, as well as sophisti- 
cated technology such as refreshable braille displays or sip and puff technology (which allows 
individuals unable to use a mouse or speech-to-text technology to send signals to a computer 
via a straw device using air pressure by sipping and puffing). One of the challenges of CBT 
has been to ensure that the assistive technology that is needed by students with disabilities is 
available and that the students know how to use it. Russell (2009) has considered this challenge 
and developed a set of 15 capabilities that should be incorporated into the computer or online 
platform (e.g., allowing all text appearing within each test item and on all interactive areas of 
the screen, including menus and navigation buttons, to be read aloud using a human voice and 
synthesized voices, etc.). 
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Perceived Advantages and Challenges of CBT 



Many of the perceived advantages and challenges of CBT have been addressed in the literature. 
Yet, most are not focused on students with disabilities. In examining perceptions and research on 
CBT, we identified several categories or “themes” that can be used to organize the advantages 
and challenges of CBT: 

• Economic: Factors that have cost implications. 

• Systems implementation: Logistical, test security, and other factors that affect the capacity 
of local education agencies and state education agencies to implement CBT. 

• Test administration/design: Factors that affect how students (and sometimes teachers) per- 
ceive and interact with the test. 

• Accessibility: Factors that affect how accessible a test is to a wide range of students. 

Appendix A provides details on the advantages and challenges of CBT for all students and for 
students with disabilities. 

Current Federal Programs that Promote CBT 

During the 2009-2010 school year, two competitions for federal funds promoted CBT. The 
Race to the Top Assessment Program was designed to support the development of innovative 
assessments based on a set of common core standards that, among many other qualities, made 
effective and appropriate use of technology. Given that the Race to the Top assessments poten- 
tially will be used by most states, the emphasis in this funding on technology is likely to have 
a significant impact on future assessment development. Responses to this program of funding 
already have generated thoughts about the interoperability of a technology platform and acces- 
sibility considerations (Mattson & Russell, 2010). 

In addition to the federal funds for the regular assessment, funding for an alternate assessment 
based on alternate achievement standards also was made available. This competition again 
emphasized technology, stating “The Secretary is also interested in projects that propose the 
development of alternate assessment systems that use approaches to technology, assessment 
administration, scoring, reporting, and other factors that facilitate the coherent inclusion of 
these assessments within States’ Comprehensive Assessment Systems” (U.S. Department of 
Education, 2010, pp. A-9-A-10). 
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Analysis of States’ Computer-based Tests 



As more states develop and implement CBT, it is important to examine the nature of these assess- 
ments and the ways in which the developers of them have considered students with disabilities. 
Without appropriate consideration, it is likely that accessibility issues will not be adequately 
addressed, with the result being an assessment that fails to produce valid results for this group 
of students. 

To examine states’ CBTs, we collected information in three steps. Initially, a scan of state de- 
partment of education Web sites was conducted to determine how many states indicated that 
they administered computer-based assessments. This occurred during late October and early 
November, 2009. A comprehensive search of state Web sites occurred later in November to 
collect additional information about states’ CBTs. 

As a third step, a second set of researchers replicated the comprehensive search to verify infor- 
mation found in the states initially identified, and to see whether additional states had posted 
CBT information. This verification occurred in February and March, 2010. The detailed results 
of the Web searches are summarized in Appendix B; the Web sites used in the analysis of states’ 
computer-based tests are listed in Appendix C. This includes only information on state Web sites. 
It is possible that other assessments exist that do not have information on the state Web site. 

The results of our search are shown in Table 1 . We found 26 states that had at least one state- 
administered computer-based test, either operational or in field testing stages. States with more 
than one type of test are noted in the table with the number of tests in parentheses. In the 26 
states with CBT, a total of 51 statewide assessments were being administered: 8 formative as- 
sessments, 24 regular tests (including retakes, graduation exams, and alternates based on grade 
level achievement standards), 14 End of Course (EOC) assessments, 3 alternate assessments 
based on modified achievement standards (AA-MAS), and 2 tests of English language profi- 
ciency (ELP) for English language learners (ELLs). One of the regular end-of-course assess- 
ments (SATP2) was being phased out in Mississippi. Two other states (Delaware and Hawaii) 
were field testing their computer-based tests in fall 2010; they are not represented in the table. 
In addition, Virginia’s Modified Achievement Standard Test (VMAST) will be administered 
online in 201 1-2012 for mathematics and 2012-2013 for reading. 
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Table 1. Number of States with CBTs Found by Type of Assessment 





Formative/ 

Diagnostic 


Regular 
(Including Exit) 


End of Course 
(EOC) 


Alternate 
based on 
Modified 
Achievement 
Standards 


English 

Language 

Proficiency 

Test 




Alaska 

Indiana 

Kentucky 

Louisiana 

South Dakota (2) 

Utah 

West Virginia 


Florida 
Idaho 
Indiana 
Kansas 
Maryland (2) 
Minnesota (4) 
Nebraska 
Oklahoma 
Oregon (3) 

South Carolina 
South Dakota 
Utah (2) 

Virginia 
Washington 
West Virginia (2) 
Wyoming 


Florida 

Georgia 

Indiana 

Oklahoma 

Louisiana 

Maryland (2) a 

Mississippi 

Missouri 

North Carolina 

South Carolina 

South Dakota 

Texas 

Virginia 


Connecticut 

Kansas 

Maryland 


Massachusetts 

Texas 


Number of 
States 


7 


16 


13 


3 


2 


Number of 
Tests 


8 


24 


14 


3 


2 



a Maryland has two EOC assessments. One is based on regular achievement standards and the second (AA- 
MAS) is based on modified achievement standards. The AA-MAS version is counted in this column. 



Regular Assessment 

As seen in Figure 1, most states (N=12) administered some type of regular assessment via CBT 
in elementary through high school grades. Only one state each administered a computer-based 
test in the other four categories: elementary and middle school only, middle school only, middle 
and high school only, and high school only. 

Table 2 shows the specific states that administered computer-based tests at the various school 
levels. South Carolina was the only state that administered CBT only at the high school level; 
South Dakota only administered its test in middle school. Both Oklahoma and Washington 
administered CBT at two school levels, while the remainder of the states (n = 12) administered 
CBT across school levels. 
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Figure 1 . Number of States with Regular CBTs Administered by the Extent that State 
Administers Them by Grade Span 
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Table 2. States Administering Regular CBTs at Different School Levels 





Elementary and 
Middle School 
Only 


Middle School 
Only 


Middle and 
High school 
Only 


High School 
Only 


Elementary 
Through High 
School 




Washington 


South Dakota 3 


Oklahoma 


South Carolina 


Florida 

Idaho 

Indiana 

Kansas 

Maryland 

Minnesota 

Nebraska 

Oregon 

Utah 

Virginia 

West Virginia 

Wyoming 


Number of 
States 


1 


1 


1 


1 


12 



a Technology assessment 

The availability of paper versions for CBT varied across states (see Table 3), as did the states’ 
perspectives on what the use of a paper version was considered to be. Paper versions were con- 
sidered by some states to be an accommodation, whereas other states considered them an ap- 
proach that anyone could use. One state required that a paper version be used if a student needed 
any accommodation. Only those states that mentioned paper versions are included in the table. 
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Table 3. Approaches of States Offering Paper Versions of Regular CBTs 





Any Accom- 
modation 
Requires 
Paper 


Certain 
Accommoda- 
tions Require 
Paper 


Paper 

Version is an 
Accommoda- 
tion 


Other 

Situations 

Needing 

Paper 


Anyone 
May Use 
Paper 


Prohibited 




Texas 


Connecticut 

Florida 

Oregon 

Virginia 


Kansas 

Oklahoma 


Connecti- 

cut 3 

Maryland 11 
Minnesota 0 
Utah d 
West Vir- 
ginia 6 


Indiana 

Maryland' 


None 


Number 
of States 


1 


4 


2 


5 


2 


0 



a Beginning in March 2010, the CMT/CAPT MAS Reading tests will be administered as a Computer Based Test 
(CBT) to all eligible students and uses the Measurement Incorporated Secured Testing (MIST) application. This 
is the same online application used with students who receive the Word Processor/Online computer response 
accommodation. Since this will be the primary method of taking this test, it is not considered an accommodation 
for these tests. If students’ disabilities interfere with what they are expected to do on MIST, they will be allowed 
to take the test in the most appropriate manner. There are, however, various input devices that may be used to 
interface with the computer. Schools should investigate these devices and determine their appropriateness for 
particular students. The MIST application includes a practice site that may be used to determine a student’s abil- 
ity to participate in online testing. If a student’s lack of experience is a true barrier, the student should be adminis- 
tered the test with the appropriate grade-level test booklet(s) and allowable accommodations. 

b On Maryland’s Technology Literacy test all students must take the online assessment unless otherwise noted in 
an IEP. 

c Minnesota retests are online. The first time a student takes the test it is paper/pencil. The student is eligible 
for a paper-administered retest of the GRAD in reading or mathematics if the student has attempted to pass the 
GRAD in the requested subject via an online retest at least three times and submits a processing fee of $45. 

d Utah is currently transitioning to 1 00% computer-based testing, except for grade 2 and students whose disabil- 
ity warrants paper-based testing. Utah indicated that students with disabilities should be encouraged to test via 
computer whenever possible. 

e ln West Virginia, the Westest 2 Online Writing is a Web-based assessment, and students must have on file an 
Acceptable Use of the Internet Form, signed by a parent or legal guardian, as directed by West Virginia Board 
of Education Policy. If a student does not have this form on file, he/she must handwrite the composition and a 
scribe will enter the composition on the Web site. 

f In Maryland, the Science test may be taken on paper or online. 

As evident in Table 3, two states were in two of the columns (Connecticut, Maryland), with the 
different columns reflecting different approaches for different tests. A total of 12 states indicated 
the use of paper versions of assessments otherwise administered on computer. As noted, Texas 
required any accommodated student to use a paper version. Four other states indicated that the 
use of specific accommodations may require a paper version instead of the online version (Con- 
necticut, Florida, Oregon, Virginia). Two states considered paper versions to be accommodations 
(Kansas, Oklahoma). Five states addressed other situations when paper versions were needed 
or implied (Connecticut, Maryland, Minnesota, Utah, West Virginia); these are reflected in the 
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table footnotes. Two states appeared to allow any student to take a paper and pencil version for 
a regular assessment (Indiana, Maryland). No state prohibited paper and pencil versions. 

End of Course Exams 

Table 4 shows the states with End of Course (EOC) exams, with an indication of whether the 
exams are computer based or only available via paper (i.e., not CBT). The existence of each form 
of EOC was examined to determine whether all EOCs were administered via CBT. As evident 
in Table 4, only 3 of the 16 states with EOCs provided the EOCs only via paper. 



Table 4. States with End of Course (EOC) Assessments That are CBT or Not CBT 





EOC Is Computer-based 


EOC Is Not Computer-based 




Florida 


Arkansas 




Georgia 


New York 




Indiana 

Louisiana 

Maryland 

Mississippi 

Missouri 

North Carolina 

Oklahoma 

South Carolina 

South Dakota 

Texas 

Virginia 


Tennessee 


Number of 
States 


13 


3 



Table 5 presents information on the availability of paper versions for computer-based EOCs. 
Eleven of the thirteen states with computer-based EOCs had information about paper versions 
of the EOCs. Most of these states (n=7) offered paper versions to any student. Only a few states 
addressed paper versions in other ways. One state noted that the paper version was required for 
certain accommodations (Oklahoma), one state allowed paper only for braille that is considered 
an accommodation (Louisiana), and two other states addressed other situations where paper 
would be needed (Mississippi, South Dakota); these are reflected in the table footnotes. As with 
the regular tests, no state noted a prohibition on paper versions for EOCs. Of those states that 
considered paper versions available to any student, Texas noted that although tests are primarily 
administered online, some content areas were still being introduced and that students had the 
option of taking paper/pencil versions at the time of this report. 
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Table 5. Approaches of States Offering Paper Versions of Computer-based EOCs 





Any Accommo- 
dation Requires 
Paper 


Certain 
Accommoda- 
tions Require 
Paper 


Paper 

Version is an 
Accommodation 


Other 

Situations 

Needing 

Paper 


Anyone 
May Use 
Paper 


Prohibited 




None 


Oklahoma 3 


Louisiana b 


Mississippi 0 
South Da- 
kota' 1 


Georgia 

Indiana 

Maryland 

Missouri 

South 

Carolina 

Texas 

Virginia 


None 


Number 
of States 


0 


1 


1 


2 


7 





a In Oklahoma, for each paper/pencil test book ordered for an IEP student, the district must have on file a copy 
of the section of the student’s IEP that indicates that a paper/pencil test is necessary to provide an appropriate 
accommodation. 

b ln Louisiana, all EOC tests are administered online, except braille, which is administered in braille and the stu- 
dent responses entered online by a teacher or test administrator. 

c ln Mississippi, Paper/Pencil retests in Algebra I and English II are for students who were first-time test takers in 
2007-2008 or 2008-2009. 

d lt is recommended students take the exams using Achievement Series, however it is recognized there may be 
times when this is not feasible. Specific instructions have been developed for utilizing EOC exams online through 
Achievement Series in addition to paper/pencil. 



Discussion and Considerations 

With the widespread and increasing use of computer-based and online testing for state and district 
assessments, it is time to examine the practices underway or in development, and to examine the 
considerations for students with disabilities. Since the Thompson et al. (2002) report examined 
the implications of computer-based testing for students with disabilities and how to address ac- 
commodations in CBT, there has been an evolving literature on this and related topics. For the 
most part, this literature has presented the advantages of CBT and has made recommendations 
for how to ensure that these assessments are appropriate for all students, including students with 
disabilities, from the beginning of their development. 

Many of the advantages attributed to CBT (see Appendix A) apply to all students, including 
students with disabilities. The one area in which the challenges seem to outweigh the advantages 
for students with disabilities is in the area of accessibility. Challenges here ranged from the pos- 
sibility of less access to computers and less experience with keyboarding than other students, to 
difficulties specifically related to certain disability characteristics, such as poor fine motor skills. 
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In addition, the possibility that applications related to accessibility are automatically turned off 
in the CBT environment was identified as a challenge. 

The analysis of states’ computer-based tests indicated that over half of the 50 states had at least 
one computer-based test either currently operational or in the field testing stages. These computer- 
based tests include regular assessments, end of course assessments, formative or diagnostic 
assessments, and assessments designated for specific populations of students (e.g., AA-MAS or 
ELP assessments). And, it was clear from the analysis that additional tests in additional states 
are under development, but not quite to the field testing stage. An examination of paper versions 
of computer-based tests indicated that most states either identify specific situations in which a 
paper version of the test might be used or require that a paper version be used when a student 
needs certain accommodations. 

Overall, these findings suggest that accessibility continues to be an issue for computer-based 
testing. Although states have moved forward with CBT during the past decade, there remains 
a need for continued thinking about maximizing the meaningful participation of students with 
disabilities in computer-based testing. Suggestions made by Thompson et al. (2002) and by 
Dolan et al. (2009) continue to be appropriate for those considering CBT. In addition, structural 
considerations, such as those made by Russell and colleagues (2009) and by Mattson and Russell 
(2010) about the CBT platform and interoperability requirements need to be brought to bear on 
accessibility for students with disabilities in CBT. 

Increasingly, states are exploring new ways to make CBT more sophisticated and interesting 
for students, including the development of simulations and increased interactivity. As the evolu- 
tion of CBT continues, several considerations are relevant for those states and districts delving 
into — or continuing — computer-based testing that will be appropriate for all students, including 
students with disabilities: 

1. Consider the assumptions and beliefs of various stakeholders about computer-based 
instruction and assessments. 

CBT design and development often are based on assumptions that drive decisions about the 
nature of the assessment, the tools that are provided as part of the assessment, and the ways in 
which students may respond to the assessment. It is important to delineate assumptions that 
drive the decisions for CBTs, so that the appropriateness of the assumptions can be examined 
before they result in an inappropriate CBT. Assumptions and beliefs can be at different levels, 
from those that underlie the design of the entire system, to those that guide the ways in which 
individual students interact with CBT. An example of broader assumption is all students interact 
with computers in the same way, and that they are similarly engaged when a test is on a computer 
platform. An example of a specific assumption about how students interact with the computer 
is the assumption that the student must be able to use a keyboard; students with disabilities use 
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a variety of assistive technology (such as sip and puff technology) to provide them access to 
computers even if they are not able to use a keyboard. 

2. Consider the system as a whole, from the computer infrastructure to classroom and 
instructional experiences with computers before deciding whether and how to use CBT. 

Computer-based testing occurs within the broader educational context, which includes the 
infrastructure of the building and classroom as well as the computer platform itself. It also 
occurs within a context in which teachers and students have had differential experiences with 
computers. Each of these, and potentially other factors, should be carefully analyzed as part of 
making decisions about CBT. Analysis of contextual factors and computer infrastructure and 
decision making about whether and how to use CBT must be influenced by the characteristics 
of all students, including those with disabilities. Thus, the capacity of school buildings and 
classrooms in a state or district must be checked in terms of the availability of computers that 
could be used for testing. This analysis needs to include schools and classrooms that may be 
designated to include only students with disabilities who meet eligibility requirements for the 
assessments to be administered via computers. Similarly, if assessments are to be Web based, 
schools and classrooms must be checked for connectivity to the Internet. This includes identify- 
ing issues that might emerge if every computer in the school is to be used at the same time for 
testing. Similar issues may result if a large number of computers in the state attempt to connect 
to an online platform on or around the same time. 

Examining the system as a whole also entails assessing the extent to which students, including 
those with disabilities, have been using computers during instruction. Although recent surveys 
have determined that most schools have computer networks and plans for replacing computers 
(Gray et al., 2010), digital equity gaps have been identified for rural schools and schools with 
high percentages of African American students (Becker, 2006). No recent study has examined 
the current status of the equity gap, which was documented in the 1990s (Waddell, 1999) for 
students with disabilities. The concern that students with disabilities still may have less access 
to computers and fewer experiences in using them during instruction must be examined in every 
school, district, and state that is planning to use CBT. 

The importance of having experiences with accommodations before they are used in the test- 
ing situation has been emphasized (e.g., Thurlow, Elliott, & Ysseldyke, 2003), and is required 
in most states’ accommodation policies (Christensen, Lazarus, Lail, Crone, & Thurlow, 2008). 
Although computer-based testing is not an accommodation, the same cautions apply. Without 
previous experiences and facility in using computers, it is possible that the introduction of the 
computer itself could depress the performance of students who have not have previously used 
a computer for instruction. 
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3. Consider the platform first, with input from individuals who know students with dis- 
abilities and their accessibility needs. 

The platform for CBTs may be strictly designed for an offline computer, or may be designed 
for an online system. In both cases, it is essential to consider the specifications for the platform 
and how they potentially interact with accessibility requirements and with various assistive 
technology that students might use. Russell (2009) has addressed this issue directly by sug- 
gesting capabilities that should be incorporated in the platform to be maximally accessible. 
Similarly, Mattson and Russell (2010) specifically addressed how to meet both interoperability 
and accessibility requirements for CBTs, noting that codes (i.e., tags) used to specify elements 
of a test or test item could be also be identified to provide accessibility instructions. Mattson 
and Russell (2010) recommend that tags and specific behaviors need to be defined that are 
expected to occur when a given tag is applied in order to “standardize the behaviors that result 
when [tags] are applied” (p. 2). 

4. Consider a process for bringing in the needed expertise to delineate the specific acces- 
sibility features of CBT, and to determine what specific accommodations may still be 
needed by students with disabilities, as well as to determine whether a computer-based 
test may create new accessibility issues. 

A process is needed to identify specific accessibility features for a given computer-based test in a 
given content area, just as it is needed for item review (Johnstone et al., 2008). This process ide- 
ally would involve stakeholders with various perspectives, including those who know the content, 
those who know students with disabilities, and those who know how to address programming 
issues that accessibility issues may create. Consideration would be given to the possible needs 
of all students with disabilities, including those that may not be addressed through accessibility 
features included in the CBT, in light of the nature of the items and tasks included on the CBT. 
These considerations must take on challenging situations and issues, such as what happens for 
a student with significant visual impairments when simulations and other virtual scenarios are 
part of CBT. In addition, consideration must be given to those accessibility features that cannot 
be incorporated into the CBT, resulting in the need still for external accommodations. 

5. Determine the policies for which accessibility features will be available to all students 
and which are designated for specific groups of students, such as students with dis- 
abilities. 

As accessibility features are incorporated into the CBT, they may no longer be considered ac- 
commodations, but instead aspects of the assessment that are available to all students. Some of 
these features, on the other hand, may be perceived as appropriate only for students with dis- 
abilities, adding the requirement that they be turned on or off depending on who the student is 
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taking the assessment. Careful consideration must be given to decisions about what accessibility 
really means and who it is for. These decisions, like other accessibility decisions, need to be 
made before or early in the design and development process. In addition, decisions about which 
accommodations a student will use need to be data-based and include students’ perceptions about 
the usefulness of accommodations. Further, students need to have used an accommodation in 
instruction before using it on a test. This can be a particularly challenging requirement for some 
technology-based accommodations that are specific to a test platform. 

6. Consider how to track the use of accessibility features incorporated into CBT design. 

An important part of considering any accessibility or accommodation feature is knowing the 
extent to which students are using those features or accommodations that they should be using. 
CBT should make it possible to track the use of various features through the technology itself. 
Then, monitoring of the relationship between recommendations on a student’s Individualized 
Education Program (IEP) and what actually occurs during the assessment (Christensen, Lail, 
& Thurlow, 2007; Christensen, Thurlow, & Wang, 2009) will be possible. States could track 
how students used the various options and accommodations as well as capture student input to 
improve the accommodations decision-making process for individual students. 

7. Field test the accessibility features of the computer-based test at the same time that 
the computer-based test is field tested. 

Accessibility features should be considered part of the design of CBT, and thus should be in- 
cluded in all pilot and field tests to which CBT is subjected. At the same time, efforts must be 
made to ensure that the full range of students is included in the field testing so that accessibility 
features can be adequately tested. 

8. Examine results from CBT for students with disabilities to determine whether there 
are any features or characteristics of the assessment that might need reconsideration. 

Results from field testing and full test administration should be continually examined to de- 
termine whether any accessibility features or other characteristics of the assessment are not 
working as intended. This will allow test developers to determine whether there is a need to 
obtain additional stakeholder information, conduct cognitive labs with students who are using 
the accessibility features, or simply revise the features. 

9. Develop training for teachers and students to ensure that students benefit from acces- 
sibility features. 

Just as there is a need for training for teachers and students about accommodations, there is a 
need for training related to most accessibility features. Students who have not experienced text- 
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to-speech as presented during the assessment (e.g., by phrase instead of by word, for example), 
need to have training to understand the working of that feature as it exists on the assessment. 
Similarly, teachers require training on accessibility features to know how they work so that as- 
sistance can be provided to students as needed. 



Conclusions 

For more than a decade CBT has been called the “new frontier of testing” (Thompson et al., 
2002). CBT has matured and is no longer a new frontier — more than half of the states now of- 
fer at least one CBT and current federal initiatives strongly encourage the continued movement 
toward technology enhanced assessments. However, there is a risk that the use of technology 
could lead to tests that are not accessible to some students with disabilities and that do not val- 
idly measure student performance. 

We now have a better understanding of both the benefits and challenges of CBT. Consideration 
of these can help guide a thoughtful approach to the development and implementation of CBT 
and potentially ensure they are accessible for all students, including students with disabilities. 
Careful planning enables states and districts to move forward in a way that capitalizes on all 
that we now know without making ambitious changes that may result in tests that are less ac- 
cessible for some groups of students. 
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Appendix A 



Advantages and Challenges of Computer-based Tests (CBTs) 

Practitioners, state department of education staff, and researchers have identified many advan- 
tages and challenges of CBTs. We identified several categories or “themes” that can be used to 
organize the advantages and challenges: 

• Economic: Factors that have cost implications. 

• Systems implementation: Logistical, test security, and other factors that affect the capacity 
of LEAs and SEAs to implement CBTs. 

• Test administration/design: Factors that affect how students (and sometimes teachers) per- 
ceive and interact with the test. 

• Accessibility: Factors that affect how accessible a test is to a wide range of students. 

Many advantages and challenges of CBTs are not specific to students with disabilities. 

In Tables A1-A4, we have listed advantages and challenges based on whether they affect all 
students or students with disabilities. This appendix ends with a brief discussion of advantages 
and challenges of CBT for ELLs with disabilities. The advantages and challenges identified in 
these tables should not be considered all-inclusive, and there probably are additional advantages 
and challenges that we have not identified. 

Economic 

Table A1 summarizes economic advantages and challenges. In the short run CBTs often cost 
more than paper and pencil tests because they are costly to develop and implement. Traditional 
tests require the printing and shipping of test booklets. Less paper is needed with CBT, and it 
may be greener and reduce the carbon footprint. However, at least in the short run, the carbon 
footprint may not be reduced. Many schools may not currently have enough computers and 
related infrastructure — and the manufacture and delivery of these items may increase the carbon 
footprint. Additional electricity will also be used. Costs may be shifted from State Education 
Agencies (SEAs) to Local Education Agencies (LEAs). SEAs generally are responsible for print- 
ing and shipping test booklets — but in some situations LEAs may be responsible for providing 
the technology that is needed to administer CBT. CBTs may cost less in the longer run than 
paper and pencil tests, but if technology continues to rapidly evolve cost savings may not occur 
in the foreseeable future (Luecht, 2005; Kettler, Scholz, Oderman, Hixon, & Weigert, 2010). 
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Table A1. Economic Advantages and Challenges of CBTs for All Students and for Students 
with Disabilities 





Advantages 


Challenges 


All Students 


• Cost-effective (long-run). 

• Reduce paper and shipping. 

• Need to prepare for a more global 
economy. 


• Cost (short-run). 

• Resource-intensive (short-run). 

• 


Students with Disabilities 


• Less costly to provide some accom- 
modations. 

• Accommodations use tracked more 
efficiently. 





Cater, Rose, Thille, and Shaffer (2010) maintain that students who participate in computer-based 
instruction and testing may be more prepared to compete in the global economy. They argue that 
today’s students need to know how to use technology to obtain good jobs, and teaching students 
to navigate and successfully complete online tests might help prepare them for the future. 

Students with Disabilities. It is costly for LEAs to provide some accommodations; and SEAs 
and LEAs expend resources keeping track of the accommodations that students receive on test 
day. There can be cost savings when many accommodations — including accommodations that 
may have been provided by a human (i.e., read aloud, scribe, sign interpret, etc.) for a paper and 
pencil test — are incorporated into CBTs (Russell, Almond, Higgins, Clarke-Midura, Johnstone, 
Bechard, & Fedorchak, 2010). 

Systems Implementation 

Table A2 summarizes the systems implementation factors. With paper and pencil tests, materials 
need to be distributed to — and collected from — each administration site. Additional test admin- 
istrators and extra rooms may be needed. However, CBTs may create their own set of logistical 
issues: Are there enough computers available? Are there technology experts available to assist 
with any computer problems? How will computer labs — or other test administration sites — be 
set up to minimize opportunities for cheating? Have students had adequate opportunities to 
leam how to use computers? (Luecht, 2005; McGrory & Sampson, 2010, McHenry, Griffith 
& McHenry, 2004). Historically there have also been equity issues related to student access to 
computers. Becker (2006) found that rural and African American students were less likely to 
have access to computers than other students. 
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Table A2. Systems Implementation Advantages and Challenges of CBTs for All Students and 
Students with Disabilities 





Advantages 


Challenges 


All Students 


• More efficient administration. 

• Data are more accurately 
collected. 

• Easier to change the test if 
mistakes are discovered. 

• Results and other data can be 
stored in much less space — 
and it is easier to retrieve. 

• Test security may be improved 
if schools and districts do not 
have hard copies ahead of 
time. 

• On-demand testing. 

• Potential to shift focus from 
assessment to instruction. 


• Test-day logistics. 

• Some schools may not have 
enough computers and related 
infrastructures. 

• Finding instructional time to teach 
students how to navigate the test 
and how to use online tools. 

• Practice tests/manuals need to be 
available far in advance of test so 
teachers can teach needed com- 
puter skills. 

• Both LEA educators and technology 
staff need training. 

• 


Students with Disabilities 


• Special test formats do not 
need to be requested in 
advance. 


• It may take longer for some stu- 
dents with disabilities to learn to 
use online tools (for example, 
measurement tools) than other 
students. 



Currently some schools do not have enough computers for all students to take large-scale tests 
within a reasonable time frame. Expanding the test window, or in some cases on-demand test- 
ing, can help resolve this challenge, but it ties up computer labs for a longer period (Ash, 2008). 
This characteristic may be particularly relevant for retests and for end-of-course tests where 
there may be a preference for administering the test soon after the completion of the course 
(Russell et al., 2010). 

Also, SEAs and LEAs sometimes lack related infrastructure. For example, according to Ash 
(2008), there is a need for “beefed-up network capacity to handle the spike in bandwidth for the 
assessment applications to run smoothly” (p. 21). Students who take a test that is interrupted by 
technology issues (e.g., loss of Internet connection, hardware or software issues) tend to perform 
less well on a test when the test administrator attempts to restart the student where they stopped 
or allow the student to start over (Bennett, Braswell, Oranje, Sandene, Kaplan, & Yan, 2008). 

CBT may help ensure that data are more accurately collected, and are easier to store. Responses 
generally are accurately captured and scored with a CBT. For example, on paper and pencil 
tests students sometimes make stray marks or messy erasures that can result in inaccurate scor- 
ing of an exam. It may also be easier to change a test if mistakes are discovered after it has 
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been finalized (Luecht, 2005; McGroroy & Sampson, 2010; McHenry et al., 2004). Still, test 
contractors continue to have major problems with scoring and data retrieval. For example, the 
June 7, 2010 online issue of the Miami Herald contained an article entitled “Glitches Delay 
Florida Test Score Report” that discussed problems with several CBTs (and other tests) including 
system- wide technology glitches and students who could not log in. The article quoted Florida 
K-12 Chancellor Frances Haithcock as saying, “Accuracy must at all times trump expediency, 
especially given the importance of these results” (McGroroy & Sampson, 2010). 

An important potential advantage of CBT at the systems level may include the shifting of focus 
from assessment to instruction. Currently some educators and others express frustration that 
assessment is driving instruction. CBTs that are closely aligned with instructional methods may 
have the potential to move the focus back to instruction (Kettler et al., 2010; Meyen, Poggio, 
Seok, & Smith, 2006). 

Classroom instruction time may be needed to train students how to navigate a computer-based 
test and how to use test tools. Different tests have different platforms — and students need to 
leam test- specific computer navigation skills. Also, without prior training students often are 
unable to correctly use online rulers, protractors, and other online measurement tools. Teach- 
ers need to plan lessons and provide instruction so that students know how to use the specific 
features and tools incorporated into a computer-based test. States and test vendors sometimes 
fail to make practice tests and manuals available far enough ahead of test day to provide suf- 
ficient instructional time. The school day is already packed and decisions need to be about what 
should be eliminated from the curriculum to find time to teach students these skills (Kettler et 
al., 2010; Russell et al., 2010; Thompson et al., 2002). 

Training is needed not only for test administrators, but also for LEA technology staff. For 
example, computers may need to have specific software downloaded prior to test day. Also, 
problems with computers on the day of the test can cause significant disruption and potentially 
cause additional anxiety in staff and students; technology staff need training so that they will 
be prepared resolve potential issues that might emerge on test day (Ash, 2008; Thompson et 
al., 2002). 

Students with Disabilities. Occasionally school district staff may not know ahead of time 
that a particular special format test (e.g., large print, braille, read aloud package, etc.) will be 
needed — for example, if a student with visual impairments enrolls in a school a few days before 
test day. Schools and districts may find CBT to be more convenient because test formats for 
students with disabilities can be customized on test day, and there is no need to order special 
formats far in advance (Kettler et al., 2010; Russell et al., 2010). 

Some students with disabilities are not in fully inclusive settings and may have fewer opportuni- 
ties to learn and practice keyboarding skills, computer navigation skills, and online tools. And, 
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some students with physical or cognitive disabilities may have particular challenges to become 
proficient keyboarders (Ketterlin-Geller, 2005). 

Test Administration and Design 

Table A3 summarizes test administration/design advantages and disadvantages. Some computer- 
based tests may have the potential to more authentically assess student learning than paper-based 
tests — though this is a more a function of test design than just the test platform (Fletcher, 2004; 
Thompson et al., 2002). Innovative CBT formats that may become more common in the future 
include role playing, simulations, and data manipulations (Russell et al. 2010). 

Another advantage of CBT may be student preference. Some students have used computers to 
play games and they may receive some of their instruction via computers. Students may also 
prefer CBT because it has the option of customizing the assessment based on personal prefer- 
ences. For example, all students may be allowed to decide what background color they would 
like on the screen, or what font size they would prefer. Although some students may prefer CBT, 
others may prefer paper and pencil tests (Cater et al., 2010; Russell et al., 2010). Interactions 
with computers may cause anxiety for some students. Computer anxiety does not refer to nega- 
tive attitudes towards computers, but rather to a student’s “emotional reaction to using comput- 
ers” (Erdogan, 2008, p. 823). Students with weak computer skills (for example, students who 
have difficulty with scrolling) are more likely to experience test anxiety (Bridgeman, Lennon 
& Jackenthal, 2001). Erdogan asserts that providing students with more opportunities to use 
computers during instruction has the potential to reduce computer anxiety. 

Educators and parents often are frustrated by how long it takes to receive test results. Teach- 
ers often need timely results for instructional decision-making purposes. Generally with CBT, 
multiple choice items can be scored with a very short turn-around (Ash, 2008; Kingston, 2009). 
For both computer-based tests and paper-based tests, there generally is a time lag in scoring 
constructed response items. Currently many states with CBT hand score open-ended items (often 
using teachers) — although “test publishers are investing heavily in automated-response systems 
that use artificial-intelligence software to better ‘read’ student answers” (Sawchuk, 2010, p. 1). 
According to Sawchuk, these systems would distance teachers from scoring assessments which 
can be a valuable professional development activity. 
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Table A3. Test Administration/Design Advantages and Challenges of CBTs for All Students and 
Students with Disabilities 





Advantages 


Challenges 


All Students 


• Increased authenticity. 

• Innovative ways to assess 
students (role playing, simula- 
tions, data manipulation). 

• May be preferred by students 

• Self-selection options. 

• Immediate results (at least for 
multiple choice items). 

• If adaptive testing is used, the 
test might be shorter. 


• Students may not always make 
good choices about which embed- 
ded resources they use. 

• Some students may have computer 
anxiety. 


Students with Disabilities 


• Built-in accommodations. 

• Some accommodations can be 
delivered more consistently. 

• 


• Read aloud/text-to-speech voice 
may be different from what student 
is used to — different accent, un- 
usual ways of pronouncing words. 

• Text-to-speech may express termi- 
nology or terms in a different way 
from instruction. (Math and scien- 
tific terms are particularly problem- 
atic.) 

• Students may not always make 
good accommodations choices. 

• Braille can be a challenge with 
CBTs. 

• Innovative test formats may be 
difficult for some students with 
disabilities (e.g., those with visual 
impairments, poor fine motor skills, 
etc.). 

• For students with visual impair- 
ments, it can be difficult to describe 
online graphics without giving away 
answer. 

• If adaptive testing is used, it can 
be difficult to ensure that students 
with gaps in their knowledge have 
the opportunity to show what they 
know. 



Some computer-based tests are computer adaptive tests (CATs) that tailor the test items that a 
student receives based on his or her correct or incorrect responses to previous items — and the 
resulting test is generally shorter than a non-adaptive test that is designed to provide similar 
information (Meyen, Poggio, Seok, & Smith, 2006). Care must be used to ensure that these 
types of CBTs appropriately assess all students. An adaptive test must be well designed to en- 
sure that students who miss questions early in the test are not denied the opportunity to answer 
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challenging questions. With some adaptive test designs some students who have gaps in their 
knowledge — including some students with disabilities — may only have the opportunity to 
answer low level questions. For example, a student may not be able to correctly answer a com- 
putation problem but could respond correctly to a problem that requires the use of higher order 
skills; the algorithms for many computer-based tests currently are not designed in ways that 
ensure that such students would have the opportunity to respond to those challenging questions 
(Almond, Winter, Cameto, Russell, Sato, Clarke, Torres, Flaertel, Dolan, Beddow, & Lazarus, 
2010; Thompson et al. 2002). 

Students with Disabilities. Some accommodations can be delivered more consistently with a 
computer-based test. For example, for a paper-based test it can be problematic to consistently 
provide some accommodations that involve a human access assistant to administer (e.g., reader, 
sign language interpreter, scribe). The quality of human readers varies greatly from one individual 
to another. Some readers may mispronounce words, use misleading intonation, or influence 
student responses. With the read aloud accommodation some human readers may use voice 
tone to suggest the correct response — whereas others would not (Clapper, Morse, Thompson, & 
Thurlow, 2005). An advantage of CBT is that technology can consistently provide the read aloud 
accommodation (Dolan, Flail, Banerjee, Chun, & Strangman, 2005) although computer-based 
tests may use a digitalized or human read aloud/text-to-speech voice that students find difficult 
to understand. The voice may have unusual ways of pronouncing words or a different accent 
from what the student is used to (Olson & Dirir, 2010). The text-to- speech function may also 
express terminology or terms in a different way from instruction. Math and science terminol- 
ogy are particularly problematic. For example, if a science test item refers to FI 2 0 should it be 
read as “FI 2 O” or as “water”? Christopher Johnstone conducted a think aloud study and found 
a clear student preference for “water” rather than “H 2 O” but that may affect the difficulty of 
the test item (Russell et al., 2010). 

In a small study focused on individuals with intellectual disabilities, Stock, Davies, and Wehm- 
eyer (2004) found that many study participants preferred computer-based tests. The participants 
particularly liked being able to take the test with little assistance. Still, when students have the 
opportunity to self-select accommodations on a computer-based test, they sometimes make poor 
decisions. Requiring the pre-selection of accommodations prior to test day can help mitigate 
this issue. Also, some students with disabilities may find innovative test formats challenging. 
Innovative formats may be especially challenging for students with visual impairments or poor 
fine motor skills. For example, it is difficult to braille innovative test items. It is also sometimes 
difficult to describe some online graphics without giving the answer away (Kamei-Hannan, 
2008; Kettler et al., 2010; Russell et al., 2010; Thompson et al., 2002). 

As noted previously, if a computer-based test is used, it can be difficult to ensure that students 
with gaps in their knowledge have the opportunity to show what they know. This can be particu- 
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larly problematic for some students with disabilities. As a result of their disability some may 
lack lower level skills and knowledge, yet know more complex information and have higher 
order knowledge. Many CATs can fail to provide these students with opportunities to show what 
they know (Thompson et al., 2002). 

Accessibility 

Table A4 summarizes accessibility factors that we identified. Well-designed, more universally 
designed assessments benefit all students — including students with disabilities. According to 
Ketterlin-Geller (2005), “computer-based technology presents an efficient tool for customizing 
assessments to meet individual needs within a universally designed environment” (p. 5). For 
example, all students would benefit if a computer-based test has allowable features that make 
the test easier to understand and navigate. Computer-based tests often allow many options for 
interacting with the assessment, which fits well with the concept of universal design. (Dolan 
et al., 2005; Russell, Hoffman, & Higgins, 2009b). However, younger students, as well as 
some other students, may have never learned how to use a keyboard or a mouse. Some early 
elementary grade students also may lack the hand size and fine motor skills to successfully use 
a keyboard. Students with weaker keyboarding skills tend to do less well on CBTs than other 
students — though this effect is diminished as keyboarding skills improve (Russell, 1999). 



Table A4. Accessibility Advantages and Challenges of CBTs for All Students and Students with 
Disabilities 



Consideration 


Advantages 


Challenges 


All Students 


• Potential for more universally 
designed assessments. 


• Some students may not have good 
keyboarding skills. 


Students with Disabilities 


• For some students with dis- 
abilities the test may be more 
accessible than a paper/pencil 
test. 

• 


• Online tests can be difficult for 
students with severe visual impair- 
ment/blind or who have poor fine 
motor skills. 

• CBTs may require more working 
memory. 

• Accessibility an issue if applications 
(for example, accessible mouse) 
that come with computer are auto- 
matically turned off. 

• Can create challenges for students 
who need a more concrete repre- 
sentation of things. 



Students with Disabilities. Some test design changes (font size, read aloud, screen background 
color, etc.) may be incorporated into the design of some CBTs. These embedded resources can 
be used to create customized, more universally designed tests for students who need an accom- 
modation to meaningfully access the test. It is much easier to provide some accommodations 
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based on individual student needs with a CBT than with a paper and pencil test (Ketterlin-Geller, 
2005; Russell et al. 2009b; Thompson et al., 2002). On a CBT some of these features may no 
longer be considered an accommodation, but instead an allowable resource that all students 
may use (Almond, et al. 2010). 

Students with some visual impairments may find CBT to be more accessible than paper and 
pencil testing because the font size can be adjusted easily. However, for students with more 
severe visual impairments or blindness, a CBT may be less accessible than a paper and pencil 
test. And, as previously discussed, braille is a challenge for current CBTs — especially with 
innovative items (Russell et al., 2010). Similar examples could be given for students with dis- 
abilities who have other characteristics. CBTs can create challenges for students who need 
more concrete representations because they often use new ways of representing information, 
and they may require the use of online tools that are visual representations (Russell et al., 2010; 
Thompson, et al., 2002). 

Some CBTs may require more working memory than similar paper and pencil tests. There 
are cognitive differences in how students interact with CBTs and paper and pencil tests. For 
example, for a reading passage, less text typically appears on the screen at any one time than 
on a page in a test booklet. Students who need to scroll through a passage may miss or forget 
key information that is needed to answer an item. CBTs that minimize the need for scrolling or 
allow students to highlight text can help mitigate this issue (Kingston, 2009). 

Delivery systems can be an issue if a student does not have access to an assistive technology 
delivery device that he or she normally uses. For test security, or other reasons, computer appli- 
cations are sometimes automatically turned off on CBTs. For example, a student may normally 
use an accessible mouse or a spellchecker that is not allowed on a CBT. Bennett et al. (2008) 
found that student performance is negatively affected when students are not allowed to use a 
familiar computer. 

ELLs with Disabilities 

Many of the same economic, systems implementation, test administration/design, and acces- 
sibility factors noted for students with disabilities in general are applicable — and sometimes 
even more of an issue — for ELLs with disabilities. For example, a digitalized or human read 
aloud/text-to-speech voice using an unfamiliar dialect can present particular challenges for 
ELLs with disabilities because dialects may not be as easily perceived by ELLs if the computer 
voice speaks with a different dialect from the one that the student hears every day. CBTs may 
also have benefits that are specific to ELLs with disabilities. For example, a CBT could offer 
an ELL with disabilities (as well as other ELLs) more levels of glosses than a paper and pencil 
test. A CBT could give a picture of an item, a glossed word tailored to a student’s language 
background, or other options. 
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Appendix B 

Computer-based Tests: Specifications and Details 



Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Alaska 


Alaska Comput- 
erized Formative 
Assessments 
(ACFA) 


Formative 


Math, Read- 
ing 


3-10 


Active 


Free for teachers, linked to grade 
level expectations, instant reporting; 
includes item pool for teachers to cre- 
ate own tests; online tools available 
for accommodations; no indication of 
paper/pencil version. 


Connecticut 


CAPT/CMT 

MAS 


Alternate 
based on 
modified 
achievement 
standards 


Reading 


3-8, 10 


Active 


“The Bureau of Student Assess- 
ment is committed to providing every 
student with the most appropriate 
access to the state tests. If students’ 
disabilities interfere with what they 
are expected to do on MIST, they 
will be allowed to take the test in the 
most appropriate manner. There are, 
however, various input devices that 
may be used to interface with the 
computer. Schools should investigate 
these devices and determine their ap- 
propriateness for particular students.” 


Florida 


Florida Compre- 
hensive As- 
sessment Test 
(FCAT) 


Regular re- 
takes 


Math, Read- 
ing, Science, 
Writing 


3-11 


Active 


For schools participating in the com- 
puter-based Retake, the number of 
paper-based tests should only reflect 
the number of students whose IEP or 
Section 504 plan indicates that they 
must test on paper, as explained in 
the Accommodations section below. 


End of Course 
(EOC) Exams 


End of 
Course 


Algebra 1, Bi- 
ology, Ameri- 
can History 


After 
course is 
taken 


Active/ 

Devel- 

oping 


Algebra 1 field test to occur in 2009- 
2010; all tests computer based only 
except for limited paper for accom- 
modation for SWD. 


Georgia 


End of Course 
Tests (EOCT) 


End of 
Course 


Math 1, II, US 
History, Econ, 
Biol, Phys 
Sci, 9 th Lit and 
Comp, Amer 
Lit and Comp 


After 
course is 
taken 


Active 


Optional paper version on main ad- 
ministrations. 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Idaho 


Idaho Standards 
Achievement 
Tests (ISAT) 


Regular 


Math, Read- 
ing, Language 
Usage, Sci- 
ence 


3-11 


Active 




Indiana 


Indiana State- 
wide Testing 
for Educa- 
tional Progress 
(ISTEP)+ 


Regular 


Math, ELA, 
Science So- 
cial Studies 


3-8 


Active 


Can also be taken via paper and pen- 
cil but was unclear for whom. 


End of Course 

Assessments 

(ECAs) 


End of 
Course 


Algebra 1, 
English 10, 
Biology 1 


After 
course is 
taken 


Active 


Both online and paper and pencil 
versions are available but unclear for 
whom. 


Grade 3-8 
Diagnostic Tools 
(Acuity™) 


Formative 


Math, English 
Language 
Arts, Science, 
Social Studies 


3-8 


Active 


May be active only in some schools; 
voluntary; schools have to pay a per 
student fee. 


Kansas 


Kansas Comput- 
erized Assess- 
ments (KCA) 


Regular 


Math, Read- 
ing, Science 


3-8, 

High 

School 


Active 


A paper/pencil copy of the assess- 
ment is available only as an accom- 
modation. 


Kansas Assess- 
ment of Modi- 
fied Measures 
(KAMM) 


Alternate 
based on 
modified 
achievement 
standards 


Math, Read- 
ing, Science 


3-8, 

High 

School 


Active 


The KAMM is considered part of 
the KCA. A paper/pencil copy of the 
assessment is available only as an 
accommodation. 


Kentucky 


Test of Primary 
Reading Out- 
comes (T-PRO) 


Diagnostic/ 

Formative 


Reading 


K - 3 


Active 




Louisiana 


End of Course 
(EOC) 


End of 
Course 


Algebra 1, 
Geometry, 
English II 


After 
course is 
taken 


Active 


Administered online only with the 
exception of the braille test. 


EAGLE 
Enhanced As- 
sessment of 
Grade Level 
Expectations 


Formative 


ELA, Math, 
Algebra 


4 ELA/ 
Math, 

9 Algebra 


Active 


They are adding grades 8,10-12 to 
math and 8-12 to ELA. 


Maryland 


Maryland School 
Assessment - 
Science (MSA- 
Science) 


Regular 


Science 


5, 8 


Active 


Paper/pencil and online versions of 
this assessment are available but not 
clear for whom. 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Maryland Modi- 
fied High School 
Assessments 
(Mod-HSA) 


End of 

Course 

alternate 

based on 

modified 

achievement 

standards 


English, Alge- 
bra/ 

Data Analysis, 
Biology, Gov- 
ernment 


High 

School 


Active 


Paper/pencil and computer versions 
of this assessment are available but 
not clear for whom. 


Modified Mary- 
land School 
Assessments 
(Mod-MSA) 


Alternate 
based on 
modified 
achievement 
standards 


Reading, 

Math 


3-8 


Active 


Paper/pencil and online versions of 
this assessment are available but not 
clear for whom. 


High School As- 
sessment 


End-of- 

course 


English, 

Algebra/Data 

Analysis, 

Government, 

Biology 


High 

School 


Active 


Paper retakes available. 


Maryland Mea- 
sure of Students 
Technology 
Literacy for 7 lh 
Grade 


Regular 


Technology 

skills 


7 


Active 


Online only, except as required by an 

IEP. 


Massachusetts 


MEPA RW 


English 
language pro- 
ficiency test 


Reading, Writ- 
ing, 


K-12 


Active 


In 2010 a small number of schools 
are being given the test on voluntary 
basis. 


Minnesota 


Science Min- 
nesota Com- 
prehensive 
Assessment - II 
(Science MCA- 

II) 


Regular 


Science 


5, 8, 
High 
School 


Active 




Mathemat- 
ics Minnesota 
Comprehensive 
Assessment III 


Regular 


Math 




Active/ 

Field 

Test 


Field tested in selected districts in 
Fall 2009. 


Graduation 
Assessment 
Required for Di- 
ploma (GRAD) 


Graduation 

Test 


Reading, 
Math, Written 
Composition 


High 

school 


Active 


Retests are online. (The first time 
a student takes the test it is paper/ 
pencil.) The student is eligible for 
a paper-administered retest of the 
GRAD in reading or mathematics if 
the student has attempted to pass the 
GRAD in the requested subject via an 
online retest at least three times and 
submits a processing fee of $45. 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Mathematics 
Test for Eng- 
lish Language 
Learners 
(MTELL) 


Regular 


Math 


3-8, 11 


Active 




Mississippi 


Subject Area 
Testing Pro- 
gram, Second 
Edition (SATP2) 


End of 
Course 


English 1, 
English II, 
Algebra 1, 
Geometry, In- 
tegrated Math 
III, Biology, 
Government 


High 

school 


Active/ 
Phas- 
ing Out 


Students who enrolled in the course 
prior to 2007-08 must take retakes 
online. New test framework for stu- 
dents who took course in 2007-08 or 
later is a paper/pencil test. 


Missouri 


Missouri End of 
Course Assess- 
ments (EOC) 


End of 
Course 


English 1, 
English II, 
Algebra 1, 
Algebra II, 
Geometry, In- 
tegrated Math 
II, Integrated 
Math III, Biol- 
ogy, American 
History, Gov- 
ernment 


High 

School 


Active 


Paper/pencil and online versions of 
this assessment are available. 


Nebraska 


Nebraska State 

Accountability 

(NeSA) 


Regular 


Reading 


3-8, 11 


Active 


The first administration will be Spring 
2010. The Math and Science tests 
are in development. The first opera- 
tional Math test will be 201 1 ; Science 
will be 2012. 


North Carolina 


End-of-Course 
(EOC) Tests 


End of 
Course 


Algebra 1, Al- 
gebra II, Biol- 
ogy, Chemis- 
try, Civics and 
Economics, 
English 1, Ge- 
ometry, Physi- 
cal Science, 
Physics, U.S. 
History 


After 
course is 
taken 


Active 


Students may take an EOC test dur- 
ing the final week or final two weeks 
of the instructional period. 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Oklahoma 


Oklahoma Core 
Curriculum Tests 
(OCCT) 


Regular 


Geography 
(Gr.7), Math 
(Gr. 8), Read- 
ing (Gr. 8). 


See Con- 
tent Area 


Active 


Students may receive paper/pencil 
accommodation if documented within 
their IEP. 

Students may receive a read-aloud 
accommodation during online testing 
(Grade 7 Geography and Grade 8 
Math). An audio accompaniment may 
be administered via headphones, or a 
test monitor may read to the student. 


End-of-lnstruc- 
tion (EOI) As- 
sessments 


End of 
Course 


Algebra 1, Al- 
gebra II, Biol- 
ogy 1, English 
II, English III, 
Geometry, 
U.S. History. 


After 
course is 
taken 


Active 


Online format not available for Writing 
portions of English II and English III 
assessments. Paper/pencil accom- 
modation available for all other EOI 
assessments (must be documented 
within student’s IEP). 


Oregon 


Oregon Assess- 
ment of Knowl- 
edge and Skills 
(OAKS) Com- 
puter Adaptive 


Regular 


Reading/ 

Literature, 

Math, 

Science, So- 
cial Sciences 


3-8, HS 
3-8, HS 
5,8,HS 
5,8,HS 


Active 


Paper/pencil accommodation avail- 
able for students if documented 
within their IEP. 

Paper version available if a district 
notes it is inappropriate for student 
(decision made by subject/specific 
content). 

“(10) School districts may only as- 
sess students in the content areas 
listed in Section 9 (a)-(c) of this rule 
using a paper-based administration 
of the OAKS assessment instead of 
OAKS Online if the following condi- 
tions are met: (a) For students with 
an IEP or 504 Plan, the student’s 
Plan indicates separately for each 
content area to be assessed that 
the student requires a paper-based 
administration; or (b) For students 
without either an IEP or 504 Plan, 
the school district determines sepa- 
rately for each content area to be 
assessed that the web-based testing 
application is not appropriate for the 
particular student to demonstrate his 
or her level of proficiency. The school 
district must base its determination 
on an individual evaluation of the 
student and on documentation of the 
student’s needs maintained by the 
school district. Such documentation is 
subject to audits by the ODE.” 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Writing Test 


Regular 


Writing 


High 

School 


Active 


Part 1 is multiple choice and is online 
only. Part 2 of test is either online or 
paper. 


Spanish Read- 
ing/ 

Literature 


Regular 


Grade 3 




Active 




South Carolina 


End-of-Course 
Examination 
Program (EO- 
CEP) 


End of 
Course 


Algebra 1, 
Biology, Math 
for Technolo- 
gies II, Eng- 
lish 1, Physical 
Science, U.S. 
History and 
the Constitu- 
tion 


After 
course is 
taken 


Active 


Optional paper versions. 


South Dakota 


End-of-Course 
(EOC) Exams 


End of 
Course 


Algebra 1 and 

II, Biology, 

Chemistry, 

Geography, 

Geometry, 

Government, 

Physical 

Science, 

Physics, U.S. 

History, World 

History 


After 
course is 
taken 


Active 


It is recommended that students take 
the EOC examination online. If online 
administration is not possible, the dis- 
trict may print off a paper copy of the 
EOC test to administer to students. 
Thus, paper version is optional. 


Dakota Assess- 
ment of Con- 
tent Standards 
(DACS) 


Formative 


DACS as- 
sesses 
performance 
in each of the 
South Dakota 
standards. 


2-12 


Active 


Standards Based Adaptive Measure- 
ment. 


8 th grade Tech- 
nology Literacy 
Assessment 


Regular 


Technology 

Literacy 


8 on 6-8 
standards 


Active 




Achievement 

Series 


Formative 

Classroom 

Tests 


Reading, 

Math, Science 


1-12 


Active 





36 



NCEO 



Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Texas 


Texas English 
Language Pro- 
ficiency Assess- 
ment System 
(TELPAS) 


English 

Language 

Proficiency 

Test 


Listening, 
Speaking, 
Reading, Writ- 
ing 


K-12 


Active 


All tests (listening, speaking, reading, 
writing) administered online. Paper/ 
pencil test is available in rare circum- 
stances. Texas Education Agency 
must grant approval for paper/pencii 
administration. 

Started Spring 2009. 


End-of-Course 

(EOC) 


End of 
Course 


Operational: 
Algebra 1, 
Geometry, Bi- 
ology, Chem- 
istry, U.S. 
History 
Field Test- 
ing: Physics, 
World Geog- 
raphy, Algebra 
II, World His- 
tory, English 1, 
II, III 


After 
course is 
taken 


Active/ 

Devel- 

oping 


Currently, EOC assessments are 
administered in the spring semester 
only and are primarily administered 
through the online testing system. 
The 2009 World Geography EOC 
field test will be offered in both on- 
line and paper formats in 2009. No 
retests are offered for EOC assess- 
ments because they are not used for 
high-stakes decisions about individu- 
al students and are not used for state 
or federal accountability reporting. 

For the 2008-2009 school year, 
the Algebra 1, Geometry, Biology, 
Chemistry, and U.S. History EOC 
Assessments will be offered on a 
voluntary basis as operational online 
test administrations. The Physics and 
World Geography EOC field tests are 
mandatory for selected campuses. 
Students taking TAKS accommodat- 
ed form must use paper version. 


Utah 


Criterion Ref- 
erenced Test 
(CRT) 


Regular 


Math 


Element- 
ary and 
Second- 
ary 


Active 


Utah is currently transitioning to 
100% computer-based testing, ex- 
cept for grade 2 and students whose 
disability warrants paper-based test- 
ing. Students with disabilities should 
be encouraged to test via computer 
whenever possible. 


Direct Writing 

Assessment 

(DWA) 


Regular 


Writing 


5, 8 


Active 


Administered beginning in Spring 
2010. 


Utah Test Item 
Pool Service 
(UTIPS) 


Formative 


ALL 


ALL 


Active 


Optional local use of test. 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Virginia 


Standards of 
Learning (SOL) 
Assessments 


Regular 


Reading, 

Mathematics, 

Science, 

U.S. History 
to 1877, 1877 
to the present, 
and Civ/Econ 


6-8 


Active 


Optional paper versions noted for all 
subjects but unclear for whom. Plain 
English Math (gr.6) and writing were 
not online as of spring 2007. ELLs or 
students with IEP or 504 plans may 
qualify to take the plain English math 
test. 


End of Course 
(EOC) Assess- 
ments 


End of 
Course 


English: 
Reading, 
Algebra 1, 
Geometry, 
Algebra II, 
Earth Sci- 
ence, Biology, 
Chemistry, 
Virginia and 
U.S. History, 
World Geog- 
raphy, World 
History 1, II 


After 
course is 
taken 


Active 


Optional paper version for all sub- 
jects. 


Washington 


Measurements 
of Student Prog- 
ress (MSP) 


Regular 


Reading, 
Math, Writing, 
Science 


3-8 


Active/ 

Devel- 

oping 


Online testing begins in Spring 2010 
for Grades 3-8 (Reading, Math), 
Grades 5 and 8 (Science). In 2010- 

2011, online practice writing tests 
will be available. Majority of online 
assessments will be operational by 

2012. 


West Virginia 


West Virginia 
Education Stan- 
dards (WEST- 
EST) 2 Writing 


Regular 


Writing 


3-11 


Active 


Paper must be used for students 
without an acceptable use of the 
Internet form (varies by county), then, 
composition will be entered by a 
scribe. 


Online Technol- 
ogy Assessment 
(TechSteps) 


Regular 


Computer 

skills 


K-8 


Active 




Online District 
Benchmark 
Interim Assess- 
ment (ODBIA) 


Formative 


Mathematics, 
Reading/ 
Language 
Arts, Science, 
Social Studies 


3-11 


Active 


Administered quarterly via Acuity 
(web-based platform). 

Unclear if optional or not. 

Note state also has other supported 
assessment programs: Riverdeep, 
Writing Roadmap, Techsteps. 
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Online Test 


Test Type 


Content Area 


Grade 


Status 


Notes 


Wyoming 


Proficiency As- 
sessments for 
Wyoming Stu- 
dents (PAWS) 


Regular 


Reading, 
Writing, Math, 
Science 


3-8 and 
11 for 
Reading, 
Writing, 
and Math. 
Grades 
4, 8, and 
11 for Sci- 
ence 


Active/ 

Devel- 

oping 


Beginning in 2008, multiple choice 
items for Reading, Math, and Science 
were administered online. Construct- 
ed response items for Reading, Math, 
and Science were administered pa- 
per/pencil. For grade 11, both items 
types were online for Reading. For 
writing all were paper for grades 3-8, 
with grade 11 online. 
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Appendix C 

Web Sites used in Analysis of States’ Computer-based Tests 



State/Test 


Source 


Alaska 




Alaska Comput- 
erized Forma- 
tive Assess- 
ments (ACFA) 


Alaska Department of Education. Statewide system of support, www.eed.state.ak.us/ 
nclb/pdf/Statewide_System_of_Support.pdf - 2009-03-26 (see page 26) 

Alaska Department of Education. Formative assessment resources, http://www.eed. 

state.ak.us/tls/assessment/FormativeAssessmentResources.html 

CAL TestBuilder. http://alaska.caltesting.org/about.html; http://alaska.caltesting.org/ 

aca_testbuilder.html 


Connecticut 




CAPT/CMT 

MAS 


Assessment Guidelines 

http://www.csde.state.ct.us/public/cedar/assessment/agl/resources/AssessmentGuide- 

Iine2009-10.pdf 

MAS memo http://www.csde.state.ct.us/public/cedar/assessment/common/MAS- 
2010memo.pdf 


Delaware 




Delaware 
Comprehensive 
Assessment 
System (DCAS) 


Delaware Department of Education. RFPfor DCAS. http://www.doe.k12.de.us/AAB/files/ 
DCAS%20RFP%20Review%20Process%20and%20Next%20Steps%20-%204.2.09.pdf 
Online testing main page: http://de.portal.airast.org/ 

Users guide: http://de.portal.airast.org/resources/DE_TA_UserGuide.pdf 
Frequently asked questions: http://de.portal.airast.org/FAQ.html 
Administration manual: http://de.portal.airast.org/resources/DE_TAM_Final.pdf 


Florida 




Florida Compre- 
hensive As- 
sessment Test 
(FCAT) 


Florida Department of Education. Frequently asked questions, http://www.fldoe.org/faq/ 
default.asp?Dept=179&ID=972#Q972 

Florida Department of Education. Next generation assessments and end of course ex- 
ams. http://www.fldoe.org/board/meetings/2009_03_17/exam.pdf 
Memos on changes: http://www.fldoe.org/asp/k12memo/ 

Memo on FCAT Updates for 2009-2010 http://www.fldoe.org/asp/k12memo/pdf/ 
FCATUpdatesFor2009-1 0.pdf 


Georgia 




End of Course 
Tests (EOCT) 


Georgia Department of Education. End of course tests, http://www.doe.k12.ga.us/ci_ 
testing. aspx?PageReq=CI_TESTING_EOCT 


Hawaii 




Hawaii State As- 
sessment (HSA) 


Hawaii Department of Education. The Hawaii States Assessment is moving online, http:// 

sas.sao.k12.hi.us/STATE/SAO/SASWebsite.nsf/5c93c85d 627a0e78a256c2f007f47bc/0 

61 958571 641 bc050a2576350005c53f/$FILE/tech_coordinator_brochure. pdf 

About the online assessment: http://sas.sao.k12. hi. us/STATE/SAO/SASWebsite.nsf/By+ 

Category/6F54B0336C8F1 DA50A257635000026EB70penDocument 

Grades and subject field test dates: http://sas.sao.k12.hi.us/STATE/SAO/SASWebsite.ns 

f/1 Odl a575953d0e908a256c340001 adab/061 95857 1 641 bc050a2576350005c53f/$FILE/ 

Scheduling%200ptions%20Brochure.pdf 

Online assessment FAQs: http://www.alohahsa.org/Events/index.php/2009/10/01/online- 
testing-faqs/ 
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Idaho 




Idaho Standards 

Achievement 

Tests 


Idaho Department of Education. ISAT online testing, http://isat.caltesting.org/about.html 

ISAT winter TAMS from here: http://www.sde.idaho.gov/site/assessment/ISAT/testCoor- 
dinators.htm 

Paper and pencil tarn: http://www.sde.idaho.gov/site/assessment/ISAT/docs/testCoordi- 
nators/ISAT-Winter-2009-p-p_TAM.pdf 

Federal and state assessments: http://www.sde.idaho.gov/site/assessment/docs/TC%20 
Guide%202009-1 0_02_09_10_version.pdf 

ISAT spring 2009 Q and A: http://www.sde.idaho.gov/site/assessment/ISAT/docs/train- 
ing/ISAT_Accommodated-Materials-Training-QA.pdf 

Test dates pdf: http://www.sde.idaho.gov/site/assessment/docs/State%20Test%20Dates. 
pdf 

“New” LEP policy from here: http://www.sde.idaho.gov/site/assessment/ISAT/testAdmin. 
htm 


Indiana 


ECA Kick-off letter for 09-10: http://www.doe.in.gov/eca/pdf/2009-10_ECA%20_Kick- 
off_Memo.pdf 

Assessment window: http://www.doe.in.gov/istep/ 

Testing Schedule for different formats: http://www.doe.in.gov/eca/pdf/Opening_of_Year_ 
Newsletter.pdf 

October 14 memo about online testing: http://www.doe.in.gov/super/2009/10- 
October/101609/documents/memo_istep_reg.pdf 

Indiana Department of Education. ISTEP. http://www.doe.in.gov/edmatters/ed_matters_ 
winter08/pdf/ISTEP+%20results%20with%20parent%20network.pdf 

Indiana Department of Education. Core 40 End of Course Assessments, http://www.doe. 
in.gov/eca/ and https://ineca.questarai.com/Admin/ 

Indiana Department of Education. Computer-based assessment tools/Grades 3-8 
Diagnostic Tools, http://www.doe. in. gov/news/2009/09-September/istep+_2009.html 
and http://www.doe.in.gov/istep/pdf/INStatewideAssessmentSystQA-021 808. pdflSTEP+ 
Program Manual 2009-201 Ohttp://www.doe. in.gov/istep/ProgramManual.html 


Kansas 




Kansas Com- 
puterized As- 
sessment (KCA) 


Kansas Department of Education. 2009-10 Assessment Examiner’s Manual http://www. 
cete. us/docs/201 0/KS_Examiners_Manual_201 0. pdf 

And revised manual http://www.ksde. org/LinkClick.aspx?fileticket=W0ahzUs6CUA%3d& 
tabid=2374 


Kansas Assess- 
ment of Modified 
Measures (KCA) 


Kansas Department of Education. 2009-10 Assessment Examiner’s Manual http://www. 
cete. us/docs/201 0/KS_Examiners_Manual_201 0. pdf 

And revised manual http://www.ksde. org/LinkClick.aspx?fileticket=W0ahzUs6CUA%3d& 
tabid=2374 


Kentucky 




T-PRO 


Kentucky Department of Education. T-PRO Kentucky http://www.cia.indiana.edu/TPRO/ 
kentucky.shtml 

TPro FAQ page; http://www.education.ky.gov/KDE/lnstructional+Resources/ 
Read+To+Achieve/FAQ/default.htm 

Testing system information: http://www.education.ky.gov/KDE/Administrative-i-Resources/ 
Testing+and+Reporting+/Kentucky+School+Testing+System/ 
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Louisiana 




End of Course 


Louisiana Department of Education. Algebra 1 End of Course (EOC) Test Assessment 
Guide http://www.doe. state. la. us/LDE/uploads/1 0252.pdf 

Louisiana Department of Education. Geometry End of Course (EOC) Test Assessment 
Guide http://www.doe.state.la.us/LDE/uploads/13211 .pdf 

Louisiana Department of Education. English II End of Course (EOC) Assessment Guide 
http://www.doe.state.la.us/LDE/uploads/11619.pdf 

EOC coordinator manual: http://www.louisianaeoc.org/Documents/EOC_Test_Coordina- 
tors_Manual.pdf 

Test schedules: http://www.doe.state.la.us/lde/saa/781.html 


EAGLE 


Assessment news for Eagle link: http://www.doe.state.la.us/lde/saa/2610.html 


Maine 




Maine Educa- 
tional Assess- 
ments 


Notice of discontinuation of online test: 

Maine Department of Education. Info Letter 31 — Changes to the Maine Educational 
Assessment at Grades 3-8. http://mailman.informe.org/pipermail/doe_letters/2008- 
0ctober/000290.html 


Maryland 




Maryland 
School Assess- 
ment - Science 
(MSA -Sci- 
ence) 


Maryland Department of Education. Testing Overview http://www.marylandpublicschools. 
org/MSDE/testing/msa/?WBCMODE=pr 

Maryland’s Accountability Assessment Program, 2008: http://www.marylandpublic- 
schools.org/nr/rdonlyres/9659f357-1 34c-4040-aeb9-5972246e764d/1 91 93/accountabil- 
ityassessmentprogramdec08.pdf 

Accommodation Manual: http://www.marylandpublicschools.org/nr/rdonlyres/840efbb6- 

cd7d-404e-8a77-e978f6d508aa/11347/mdaccommodationsmanual.pdf and 

http://www.marylandpublicschools.org/NR/rdonlyres/840EFBB6-CD7D-404E-8A77- 

E978F6D508AA/16337/MDAccommodationsManual_21 108.pdf 

Maryland State Department of Education Student Testing Calendar School Years 2009- 

2010 through 2013-2014 

http://www.marylandpublicschools.org/nr/rdonlyres/840efbb6-cd7d-404e-8a77- 
e978f6d508aa/24340/msde_testing_calendar_2009_201 0_201314_rev_03_17.pdf 


Maryland Modi- 
fied High School 
Assessments 
(Mod-HSA) 


Maryland Department of Education. HSA: High School Assessment Program, http:// 
mdk12.org/assessments/high_school/index_d2.html 

Maryland’s Accountability Assessment Program, 2008: http://www.marylandpublic- 
schools.org/nr/rdonlyres/9659f357-1 34c-4040-aeb9-5972246e764d/1 91 93/accountabil- 
ityassessmentprogramdec08.pdf 

Accommodation Manual: http://www.marylandpublicschools.org/nr/rdonlyres/840efbb6- 
cd7d-404e-8a77-e978f6d508aa/11347/mdaccommodationsmanual.pdf and 
http://www.marylandpublicschools.org/NR/rdonlyres/840EFBB6-CD7D-404E-8A77- 
E978F6D508AA/16337/MDAccommodationsManual_21 108.pdf 

Anne Arundal County Public Schools. Testing Calendar for Federal and State Mandated 
Assessments and College Board Exams 2009 -2010. http://www.aacps.org/testing/ 
testing.pdf 
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Maryland 
Modified Middle 
School Assess- 
ments (Mod- 
MSA) 


Maryland Department of Education. Parent Guide to the Modified School Assessment - 
Mod-MSA http://marylandpublicschools.org/NR/rdonlyres/5F4F5041-02EE-4F3A-B495- 
5E4B3C850D3E/2281 8/ModMSA_WhatltMeans_01 0709.pdf 
Maryland’s Accountability Assessment Program, 2008: 

http://www.marylandpublicschools.org/nr/rdonlyres/9659f357-134c-4040-aeb9- 
5972246e764d/1 91 93/accountabilityassessmentprog ramdec08.pdf 
Accommodation Manual: http://www.marylandpublicschools.org/nr/rdonlyres/840efbb6- 
cd7d-404e-8a77-e978f6d508aa/11347/mdaccommodationsmanual.pdf and 
http://www.marylandpublicschools.org/NR/rdonlyres/840EFBB6-CD7D-404E-8A77- 
E978F6D508AA/16337/MDAccommodationsManual_211 08.pdf 

Anne Arundal County Public Schools. Testing Calendar for Federal and State Mandated 
Assessments and College Board Exams 2009 -2010. http://www.aacps.org/testing/test- 
ing.pdf 


Massachusetts 




MEPA 


New features for MEPA (ELP test): http://www.doe. mass. edu/news/news.aspx?id=4542 


Minnesota 




Science Min- 
nesota Com- 
prehensive 
Assessment - II 
(Science MCA- 

II) 


Minnesota Department of Education. Online Testing http://education.state.mn.us/MDE/ 

Accountability_Programs/Assessment_and_Testing/DAC_Corner/Online_Testing/index. 

html 

Minnesota Department of Education. Procedures Manual for Minnesota Assessments: 
2009-2010 http://education.state.mn.us/mdeprod/groups/Assessment/documents/Manu- 
al/035664.pdf 

Minnesota Department of Education. Minnesota Comprehensive Assessments - Science 
http://education.state.mn.us/mdeprod/groups/Assessment/documents/FAQ/007863.pdf 


Graduation 
Assessment 
Required for Di- 
ploma (GRAD) 


Minnesota Department of Education. Online Testing http://education.state.mn.us/MDE/ 

Accountability_Programs/Assessment_and_Testing/DAC_Corner/Online_Testing/index. 

html 

Minnesota Department of Education. Procedures Manual for Minnesota Assessments: 
2009-2010 http://education.state.mn.us/mdeprod/groups/Assessment/documents/Manu- 
al/035664.pdf 

Minnesota Department of Education. Graduation Assessment Required for Diploma 
(GRAD) http://education.state.mn.us/MDE/Accountability_Programs/Assessment_and_ 
Testing/Assessments/GRAD/index.html 


Mathematics 
Test for Eng- 
lish Language 
Learners 
(MTELL) 


Minnesota Department of Education. http://education.state.mn.us/MDE/Accountability_ 
Prog rams/ Assessment_and_Testing/Assessments/ELL_Tests/index. html 
Minnesota Department of Education. Procedures Manual for Minnesota Assessments: 
2009-2010 http://education.state.mn.us/mdeprod/groups/Assessment/documents/Manu- 
al/035664.pdf 

Minnesota Department of Education. Frequently Asked Questions: Mathematics Test for 
English Language Learners (MTELL) http://education.state.mn.us/mdeprod/groups/As- 
sessment/documents/FAQ/030683.pdf 

Minnesota Department of Education. Online Testing http://education.state.mn.us/MDE/ 
Accountability Programs/Assessment and Testing/DAC Corner/Online Testing/index, 
html 
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Mississippi 




Subject Area 
Testing Pro- 
gram, Second 
Edition (SATP2) 


Mississippi Department of Education. Subject Area Testing Program, Second Edition 

(SATP2) http://www.mde.k12.ms.us/acad/osa/2009/2SATP_DTC_FALL_09v8.pdf 

SATP2 School Test Coordinator Manual: http://www.mde.k12.ms.us/acad/osa/2010_ 

Guidelines/SATP2%20School%20Test%20Coordinator%20Manual.pdf 

09-10 testing calendar: http://www.mde.k12.ms.us/acad/osa/cal.html 

District Coordinator Training: Fall 2009: http://www.mde.k12.ms.us/ACAD/osa/dtc.html 


Missouri 




Missouri End of 
Course Assess- 
ments (EOC) 


Missouri Department of Education. Missouri End of Course Assessments (EOC) Test 
Examiner’s Manual Phase 1 Assessments 2009-2010. http://dese.mo.gov/divimprove/as- 
sess/documents/2009-201 OEOC_Phase_l_TEM_OOO.pdf 

Missouri Department of Education. Missouri End of Course Assessments (EOC) Test 
Examiner’s Manual Phase 1 Assessments 2009-2010. http://dese.mo.gov/divimprove/as- 
sess/documents/2009-201 0_EOC_Phase_ll_TEM_000.pdf 

Discontinued Integrated Math on EOC site: http://dese.mo.gov/divimprove/assess/eoc. 
html 

2009-10 Test Examiner Manual: http://dese.mo.gov/divimprove/assess/docu- 
ments/2009-201 0 _EOC_Online_TEM_OOO.pdf 

EoCTCM 09-10: http://dese.mo.gov/divimprove/assess/documents/2009-2010 EOC 
TCM_000.pdf 

EoC assessments 2009-10: www.dese.mo.gov/divimprove/assess/documents/EOC- 
Assessments2009-201 0.ppt 


Nebraska 




Nebraska State 

Accountability 

(NeSA) 


Nebraska Department of Education. About Nebraska State Accountability: NeSA http:// 
nesa.caltesting.org/about.html 

NESA online manual : http://www.nde.state.ne.us/Assessment/documents/Final-Spring- 
2009NeSA-RTAM.pdf 

NESA accommodations document: http://www.nde.state.ne.us/Assessment/documents/ 
NeSA_Accommodations.pdf 


North Carolina 




Computer Skills 
Test 


North Carolina Department of Public Instruction. Memorandum: Transition Plan for Com- 
petency and Computer Skills 

http://www.ncpublicschools.org/docs/accountability/policyoperations/transition/transition- 

planletter.pdf 

Eliminated tests as of 09-10: http://www.dpi.state.nc.us/accountability/testing/suspend- 
admin 

http://www.dpi.state.nc.us/accountability/testing/ 


End-of-Course 
(EOC) Tests 


North Carolina Department of Public Instruction. North Carolina End-of-Course Tests 
http://www.ncpublicschools.org/accountability/testing/eoc/ 

NCTest link: http://cuacs8.mck.ncsu.edu/nctest/ 

EoC tests: http://www.dpi.state.nc.us/accountability/testing/eoc/ 


Oklahoma 




Oklahoma Core 
Curriculum 
Tests (OCCT) 


Oklahoma State Department of Education. Oklahoma School Testing Program, http:// 
www.sde. state. ok. us/AcctAssess/pdf/OSTPBrochure. pdf 

Core test prep manual: http://www.sde.state.ok.us/AcctAssess/pdf/Core/TestPrepManu- 
al.pdf 

2009 Test Interpretation Manual Grades 3-8 Oklahoma Core Curriculum Tests 
http://www.sde.state.ok.us/AcctAssess/pdf/forms/TIMGr3_8.pdf 
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End-of-lnstruc- 
tion (EOI) As- 
sessments 


Oklahoma State Department of Education. Frequently Asked Ouestions Oklahoma 
School Testing Program (2009-2010), http://www.sde.state.ok.us/AcctAssess/pdf/FAQ 
OSTP.pdf 

EOI Online Guide: http://sde.state.ok.us/AcctAssess/pdf/forms/EOIOnlineGuide.pdf 
EOI Test prep manual: http://www.sde.state.ok.us/AcctAssess/pdf/forms/EOITestPrep. 
pdf 

Test prep manual modified: http://www.sde.state.ok.us/AcctAssess/pdf/OMAAP/Test- 
PrepManual.pdf 

User Guide: http://sde.state.ok.us/AcctAssess/pdf/forms/UserGuide.pdf 


Oregon 




Oregon Assess- 
ment of Knowl- 
edge and Skills 
(OAKS) Com- 
puter Adaptive 


Test Administration manual: http://www.ode. state. or.us/search/page/?=486 
Oregon Department of Education. Test Administration Manual, Appendix A: 2009-2010 
Test Schedule and Required Ship Dates, http://www.ode.state.or.us/wma/teachlearn/ 
testing/admin/appendix_a.pdf 

Oregon Department of Education. Test Administration Manual, Appendix N: OAKS Paper 
and Pencil, http://www.ode.state.or.us/wma/teachlearn/testing/admin/appendix_n.pdf 
Accommodations Manual http://www.ode.state.or.us/teachlearn/testing/admin/alt/ea/ 
oregon-accommodations-manual-2009-2010.pdf 


Writing Test 


Test Administration manual: http://www.ode. state. or.us/search/page/?=486 

Oregon Department of Education. Oaks Online User Guides, http://www.ode.state.or.us/ 

search/page/?=391 

Accommodations Manual http://www.ode.state.or.us/teachlearn/testing/admin/alt/ea/ 
oregon-accommodations-manual-2009-2010.pdf 


Spanish Read- 
ing/ 

Literature 


Oregon Department of Education. 2009-2010 Test Administration Manual. http://www. 
ode. state. or. us/search/page/?=486 

Accommodations Manual http://www.ode.state.or.us/teachlearn/testing/admin/alt/ea/ 
oregon-accommodations-manual-2009-2010.pdf 


South Carolina 




End-of-Course 
Examination 
Program (EO- 
CEP) 


South Carolina Department of Education. End-of-Course Examination Program (EO- 
CEP). 

http://ed.sc.gov/agency/Accountability/Assessment/old/assessment/programs/end- 
ofcourse/End-of-CourseExaminationProg ramEOCEP.html. 

Updated 09-10 materials with DTC supplement: http://ed.sc.gov/agency/Accountability/ 
Assessment/old/assessment/publications/manuals2.html 


South Dakota 




End-of-Course 
(EOC) Exams 


South Dakota Department of Education. End of Course Exams: Procedure Manual 
http://doe.sd.gov/octa/assessment/EOC/index.asp 

EOC procedure manual http://doe.sd.gov/octa/assessment/EOC/docs/manual/1-6.pdf 
Assessment overview: http://doe.sd.gov/octa/assessment/docs/SD_AssessmentSystem- 
Overview_808.pdf 


Dakota Assess- 
ment of Con- 
tent Standards 
(DACS) 


South Dakota Department of Education. DACS Frequently Asked Questions. http://doe. 
sd.gov/octa/assessment/dacs/faqs.asp 

DACS administration link: http://doe.sd.gov/octa/assessment/dacs/manual.asp 


8 th Grade Tech- 
nology Literacy 
Test 


8 th grade technology literacy test page: http://doe.sd.gov/contentstandards/NCLB/as- 
sessment.asp 


Achievement 

Series 


South Dakota Department of Education. Achievement Series, http://doe.sd.gov/octa/as- 
sessment/documents/AS%20Website%20info.pdf 
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Texas 




Texas Assess- 
ment of Knowl- 
edge and Skills 
(TAKS) 


Texas Education Agency. Chapter 2: Texas Assessment of Knowledge and Skills (TAKS) 

Overview, http://www.tea. state. tx.us/index3.aspx?id=948&menu_id=793 

2010 DCCM overview: http://ritter.tea.state.tx.us/student.assessment/resources/guides/ 

coormanual/dccm_overview.pdf 

2010 supplement here from same main page: http://ritter.tea.state.tx.us/student.assess- 
ment/resources/guides/coormanual/dccm_supplement.pdf 

Accommodations Manual http://ritter.tea.state.tx.us/student.assessment/resources/ac- 
commodations/AccommManual_2009_10.pdf 


Texas English 
Language Pro- 
ficiency Assess- 
ment System 
(TELPAS) 


Texas Education Agency. TELPAS: Texas English Language Proficiency Assessment 
System: Manual for raters and test administrators http://ritter.tea.state.tx.us/student.as- 
sessment/ELL/TELPASManual.pdf 

TELPAS 2010: http://ritter.tea.state.tx.us/student.assessment/resources/guides/coor- 
manual/dccm_telpas.pdf 

2010 TELPAS coordinators’ supplement (main page link): http://www.tea.state.tx.us/in- 
dex3.aspx?id=3680&menu_id=793#telpas 

Accommodations Manual http://ritter.tea.state.tx.us/student.assessment/resources/ac- 
commodations/AccommManual_2009_10.pdf 


End-of-Course 

(EOC) 


Texas Education Agency. End of Course (EOC) Assessments, http://www.tea.state.tx.us/ 
index3.aspx?id=3302&menu_id=793 

Accommodations Manual http://ritter.tea.state.tx.us/student.assessment/resources/ac- 
commodations/AccommManual_2009_10.pdf 


Utah 




Criterion Ref- 
erenced Test 
(CRT) 


Utah State Office of Education. 2009 Utah Elementary Mathematics CRT Online (CBT) 
Test Overview, http://www.schools.utah.gov/assessment/info_math.aspx 
Special needs accommodations policy: http://www.schools.utah.gov/assessment/docu- 
ments/Special_Needs_Accommodations_Policy.pdf 

Test administration calendar 09-10: http://schools.utah.gov/assessment/documents/ 
DA_Test_Administration_Calendar_09-10.pdf 

Site Coordinator Manual: http://www.schools.utah.gov/assessment/documents/DA_Site_ 
Coordinator_Manual_2009031 1 .pdf 


Direct Writing 

Assessment 

(DWA) 


Utah State Office of Education. Direct Writing Assessment, http://www.schools.utah.gov/ 
assessment/info_math.aspx 

Special needs accommodations policy: http://www.schools.utah.gov/assessment/docu- 
ments/Special_Needs_Accommodations_Policy.pdf 


Utah Test Item 
Pool Service 
(UTIPS) 


Utah State Office of Education. Utah Test Item Pool Service: UTIPS for CRT and All Sub- 
jects. http://www.schools.utah.gov/assessment/utips/default.aspx 
Special needs accommodations policy: http://www.schools.utah.gov/assessment/docu- 
ments/Special_Needs_Accommodations_Policy.pdf 


Virginia 




Standards of 
Learning (SOL) 
Assessments 


Virginia Department of Education. 2009-2010 Non-Writing Examiners Manual (Grades 
6,7,& 8). http://www.doe.virginia.gov/testing/test_administration/index.shtml 
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End of Course 
(EOC) 


Virginia Department of Education. 2009-2010 Non-Writing Examiners Manual (End of 
Course: Reading). 

http://www.doe.virginia.gov/testing/test_administration/index.shtml 

Virginia Department of Education. 2009-2010 Non-Writing Examiners Manual (End of 

Course: History). 

http://www.doe.virginia.gov/testing/test_administration/index.shtml 

Content specific history manual: http://www.doe.virginia.gov/testing/test_administration/ 

manuals/examiners/content_specific_history.pdf 

Fall 2009 writing tests: http://www.doe.virginia.gov/testing/test_administration/manuals/ 
test_implementation/fall_writing.pdf 

Virginia Department of Education. 2009-2010 Non-Writing Examiners Manual (End of 
Course: Mathematics). 

http://www.doe.virginia.gov/testing/test_administration/index.shtml 

Virginia Department of Education. 2009-2010 Non-Writing Examiners Manual (End of 

Course: Science). 

http://www.doe.virginia.gov/testing/test_administration/index.shtml 


Washington 




Measurement of 
Student Prog- 
ress (MSP) 


Washington Office of Superintendent of Public Instruction. 

State Testing: Rollout Schedule for Online Testing. 

http://www.k12.wa.us/assessment/StateTesting/OnlineTestingRolloutSchedule.aspx 
Online MSP testing page: http://wa-online.caltesting.org/about.html 


High School 
Proficiency 
Exam (HSPE) 


Washington Office of Superintendent of Public Instruction. 

State Testing: Rollout Schedule for Online Testing. 

http://www.k12.wa.us/assessment/StateTesting/OnlineTestingRolloutSchedule.aspx 


West Virginia 




West Virginia 
Education Stan- 
dards (WEST- 
EST) 2 Writing 


West Virginia Department of Education. WESTEST 2 Online Writing Overview, http:// 
wvde. state. wv.us/oaa/writing/wajndex.html 

Westtest2 Online Writing FAQs: http://wvde.state.wv.us/oaa/writing/wa_w2faq.html 


Online Technol- 
ogy Assessment 


West Virginia Department of Education. Assessments and Accountability. http://wvde. 
state.wv.us/oaa/ 


Online District 
Benchmark 
Interim Assess- 
ment (ODBIA) 


West Virginia Department of Education. Assessments and Accountability. http://wvde. 
state.wv.us/oaa/ 

ODBIA information: http://wvde.state.wv.us/oaa/acuity.php 


Techsteps 


Information about Techsteps: 

http://wvde.state.wv.us/teach21/techsteps.html 

http://www.techsteps.com/WV/techStepsK-8.htm 


Wyoming 




Proficiency As- 
sessments for 
Wyoming Stu- 
dents (PAWS) 


Wyoming Department of Education. Proficiency Assessments for Wyoming Students 
(PAWS) Pre-Administration Training December 1-7, 2009. http://www.k12.wy.us/SA/ 
Paws/Paws_lnfo/2009_1 0/PAWS%202010%20Pre-Administration%20Training%20Pow- 
erpoint.pdf 

Technical Manual, Spring 2009: here:http://www.k12.wy.us/SA/Paws/Resources/ 

Docs/2009%20Technical%20Manual.PDF 

Accommodations Manual 

http://www.k12.wy.us/SA/Paws/Paws_lnfo/2009_10/AccommodationsManual.pdf 
Accommodations Information: 

http://www.k12.wy.us/SA/Paws/Paws_lnfo/2009_10/PAWS_accomodations.PDF 
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